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ABSTRACT 


-Suppose  Chat  two  machines  are  available  to  process  n  tasks.  Each 
task  has  to  be  processed  on  both  machines,  the  order  in  which  this  happens 
is  immaterial.  Task  j  has  to  be  processed  on  machine  1  (2)  for  random 
time  X^(Yj)  with  distribution  F (G  )  .  This  kind  of  model  is  usually 
called  an  Open  Shop.  The  time  that  it  takes  to  process  all  tasks  is 
normally  called  the  makespan.  Every  time  a  machine  finishes  processing 
a  task  the  decision-maker  has  to  decide  which  task  to  process  next. 
Assuming  that  X^  and  Y_.  have  the  same  exponential  distribution  we 
show  chat  the  optimal  policy  instructs  the  decision-maker,  whenever  a 
machine  is  freed,  to  start  processing  the  task  with  longest  expected 
processing  time  among  the  tasks  still  to  be  processed  on  both  machines. 

If  all  tasks  have  been  processed  at  least  once,  it  does  not  matter  what 
Che  decision-maker  does,  as  long  as  he  keeps  the  machine  busy.  We  then 
consider  the  case  of  n  identical  tasks  and  two  machines  with  different 
speeds.  The  time  it  takes  machine  1  (2)  to  process  a  task  has  distribu¬ 
tion  F(G)  .  Both  distributions  F  and  G  are  assumed  to  be  New  Better 


chan  Used  (NBU)  and  we  show  that  the  decision-maker  stochastically  mini¬ 
mizes  the  makespan  when  he  always  gives  priority  to  those  tasks  which 


MINIMIZING  EXPECTED  MAKESPAN  IN  STOCHASTIC  OPEN  SHOPS 


by 

Michael  L.  Pinedo  and  Sheldon  M.  Ross 


1.  INTRODUCTION  AND  SUMMARY 


Suppose  that  two  machines  are  available  to  process  n  tasks.  Each 
task  has  to  be  processed  on  both  machines,  the  order  in  which  this  happens 
is  immaterial.  Task  j  has  to  be  processed  on  machine  1  (2)  for  random 
time  X^ (Y j )  with  distribution  (G^ )  .  This  kind  of  model  is  usually 

called  an  Open  Shop.  The  time  that  it  takes  to  process  all  tasks  is 
normally  called  the  makespan.  Every  time  a  machine  finishes  processing  a 
task  the  decision-maker  has  to  decide  which  task  to  process  next.  A  policy 
prescribes,  as  a  function  of  the  state  of  the  system,  the  actions  to  take 
at  the  various  decision  moments;  of  interest  are  the  policies  that  minimize 
the  expected  makespan. 

Gonzalez  and  Sahni  [1]  considered  the  case  where  the  processing  times 
are  deterministic  and  presented  an  0(n)  algorithm  to  find  an  optimal 
schedule.  The  case  of  stochastic  processing  times  has,  to  our  knowledge, 
not  yet  been  considered  in  the  literature. 


In  the  first  section  of  this  paper,  we  assume  that  X.  and  Y.  have 

J  j 

the  same  exponential  distribution  with  rate  •  We  show  that  the  optimal 
policy  instructs  the  decision-maker,  whenever  a  machine  is  freed,  to  start 


processing  the  task  with  longest  expected  processing  time  among  the  tasks 
still  to  be  processed  on  both  machines.  If  all  tasks  have  been  processed 


at  least  once,  it  does  not  matter  what  the  decision-maker  does,  as  long  as 
he  keeps  the  machine  busy. 


2 


In  the  second  section  we  consider  the  case  of  n  identical  tasks 
and  two  machines  with  different  speeds.  The  time  it  takes  machine  1  (2) 
to  process  a  task  has  distribution  F(G)  .  Both  distributions  F  and 
G  are  New  Better  than  Used  (NBU) .  We  show  that  the  decision-maker 
stochastically  minimizes  the  makespan  when  he  always  gives  priority  to 
those  tasks  which  have  not  yet  received  processing  on  either  machine. 

In  the  last  section  the  case  of  n  identical  tasks  and  two  identical 
machines  will  be  considered.  The  processing  time  of  a  task  on  a  machine 
has  an  exponential  distribution  with  rate  one.  A  closed  form  expression 
for  the  expected  makespan  under  the  optimal  policy  is  given. 


uirfirov 


I 
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2.  THE  CASE  OF  EXPONENTIAL  PROCESSING  TIMES 


In  this  section  we  assume  chat  and  have  the  same  exponential 

distribution  with  rate  . 

Note  that  a  policy  only  has  to  instruct  the  decision-maker  what  to 
do  as  long  as  there  are  still  tasks  waiting  for  their  first  processing. 

This  is  true  for  the  following  reason:  when  machine  1  (2)  becomes  free, 
the  decision-maker  can  otherwise  choose  only  from  tasks  which  have  to  be 
processed  on  machine  1  (2)  alone  and  the  sequence  in  which  these  tasks 
will  be  processed  on  machine  1  (2)  will  not  affect  the  makespan. 

If  M  denotes  the  makespan  then  clearly 


M  >  max 


(  I  v  l  \) 

\  i-1  1  i-1  V 


The  makespan  may  be  strictly  larger  than  the  R.H.S.  of  (1)  when  one 
machine  is  kept  idle  for  some  time  in  between  the  processing  of  two 
tasks.  A  distinction  will  be  made  between  two  types  of  idle  periods 


(see  Figure  1). 

In  an  idle  period  of  type  II,  a  machine  is  kept  idle  for  some  time, 
say  ,  then  processes  the  last  task,  say  task  j  ,  and  finishes  pro¬ 
cessing  task  j  while  the  other  machine  is  still  busy.  It  is  clear  that, 
although  a  machine  has  been  kept  idle  for  some  time,  the  makespan  is  never¬ 
theless  equal  to  the  R.H.S.  of  (1).  In  an  idle  period  of  type  I,  a  machine 
is  kept  idle  for  some  time,  say  ,  then  processes  the  last  task,  say 
task  j  ,  and  finishes  processing  this  task  some  time,  say  Jj  ,  after  the 
other  machine  has  finished  processing  its  tasks.  Now 


M  -  max 


(  I  v  l  Yi)  +  N 

V i-1  i-1  / 


>*  , . 


machine  1 


machine 


Idle  Period  of  Type  I 


task  j 


FIGURE  1 


•-iSfcHnucS**. 


where 


N  -  min  (J^,  • 


It  can  be  verified  easily  that  only  one  task  can  cause  an  idle  period 
and  an  idle  period  has  to  be  either  of  type  I  or  type  II.  In  the  re¬ 
maining  part  of  the  paper  superscripts  will  consistently  refer  to  policies, 
e.g.  M°  denotes  the  makespan  under  policy  it0  ,  N°  denotes  the  second 
term  on  the  R.H.S.  of  (2)  under  it0  ,  etc.  Let  p°  denote  the  probability 
that  task  j  causes  an  idle  period  of  type  I  under  policy  7r°  .  Then, 
after  taking  expectations  on  both  sides  of  (2),  we  obtain 


E(M°)  -  E|max  |  ^  Y.j  j  +  E(N° 


where 


As  the  first  term  on  the  R.H.S.  of  (3)  does  not  depend  on  the  policy, 
it  suffices  to  find  a  policy  which  minimizes  the  second  term  on  the 
R.H.S.  of  (3). 

Before  continuing  with  our  analysis  of  the  Open  Shop  model  we  will 
consider  a  simpler  scheduling  model;  a  model  where  the  tasks  have  to  be 
processed  only  once  on  either  one  of  the  two  machines.  This  model  has 
been  treated  in  the  literature  extensively  for  various  objective  functions, 
see  [2],  [3],  [4].  Assume  that  at  decision  moment  t  one  machine  is  free 
and  the  other  one  is  busy  processing  task  0.  A  policy  •••»  Jr  > 

a  permutation  of  1,2,  ...,  r  ,  prescribes  that  at  time  t  task  j^  is 


'2VR)>' 


T 


put  on  the  empty  processor;  the  next  time  a  processor  is  freed  task 
is  started,  etc.  For  this  model  we  have 

Lemma  1: 

1  2 

Let  (q^ )  ,  j  -  0,1,2,  ...,  r  ,  denote  the  probability  that  the  last 

1  2 

task  to  be  finished  under  policy  it  *  1,2,3,  ...,  r-l,r  (it  ■  2,1,3, 

....  r-l,r)  is  task  j  .  When  »  min  •••»  Ur)  ,  then,  for 

any  task  0,  not  necessarily  exponentially  distributed, 


i  »  2 . r 

2 

i=*l  *  i-1  i 

Proof : 

See  Lemma  1  in  Pinedo  and  Weiss  [2].B 

Although  Lemma  1  was  originally  set  up  to  analyze  a  simpler  model, 
where  tasks  have  to  be  processed  only  once  on  either  one  of  the  two 
machines,  it  will  play  an  important  role  in  the  analysis  of  the  more  com¬ 
plicated  Open  Shop  model  we  have  under  consideration  in  this  paper.  In 
Theorem  1  the  lemma  will  be  used  repeatedly,  applied  on  a  set  of  tasks 
which  after  a  specific  time  t  have  to  undergo  their  first  processing 
on  either  one  of  the  two  machines.  As  long  as  there  are  tasks  waiting 
for  their  first  processing  no  task  will  start  its  second  processing. 


and 


<1  -qi 
1  2 
qj  ~qj 


r 

l 
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We  will  be  interested  in  the  probabilities  of  each  task  of  this  set  being 
the  last  one  of  the  set  to  finish  its  first  processing.  These  prob¬ 
abilities  are  needed  when  computing  the  probability  of  a  task  causing 
an  idle  period  of  type  I,  as  for  a  task  to  cause  a  type  I  idle  period 
it  must  have  been  the  last  task  to  finish  its  first  processing. 

Theorem  1: 

The  policy  that  minimizes  the  expected  makespan  is  the  policy  which, 
whenever  either  of  the  two  machines  is  free,  instructs  the  decision-maker 

(i)  when  there  are  still  tasks  which  have  not  yet  received  process¬ 
ing  on  either  machine,  to  start  among  these  the  one  with  the 
largest  expected  processing  time  and 

(ii)  when  all  tasks  have  been  processed  at  least  once,  to  start 
any  one  of  the  tasks  still  to  be  processed  on  the  machine 
just  freed. 

Proof : 

Assume  at  decision  moment  t  one  processor  is  idle  and  the  second  one 

* 

is  processing  task  0  with  an  arbitrary  distribution.  Let  it  denote  the 

* 

policy  stated  in  the  theorem.  In  order  to  prove  that  n  is  optimal  it 

•k 

suffices  to  show  that  using  7r  from  t  onwards  results  in  a  smaller 

* 

expected  makespan  than  acting  differently  at  t  and  using  tt  from  the 

■next  decision-moment  onwards.  Two  types  of  actions  at  t  which  are  not 
* 

according  to  ir  have  to  be  considered.  Firstly,  it  is  possible  to  start 
a  task  which  has  not  yet  been  processed  on  either  machine,  but  which  is 
not  the  largest  task  among  the  tasks  not  been  processed  on  either  machine. 
Secondly,  it  is  possible  to  start  a  task  which  already  has  been  processed 
on  the  other  machine. 
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The  following  notation  will  be  used:  {A}  denotes  the  set  of  tasks 
that  at  t  did  not  yet  finish  their  first  processing,  while  {B}  denotes 
the  set  of  tasks  that  at  t  did  not  yet  start  their  second  processing. 
Clearly  {B}  D  {A}  . 


Case  1: 


Let  it  denote  the  policy  which  instructs  the  decision-maker  at  time 

t  to  start  task  m  with  rate  p  ,  m  €  A  ,  where  m  is  not  the  largest 

m 

* 

task  among  tasks  in  {A}  and  to  adopt  policy  tt  from  the  next  decision 

1  * 

moment  onwards.  Let  q^.  (q ^ )  ,  j  G  A  ,  denote  the  probability  that  task 

1  * 

j  is  the  last  task  to  finish  its  first  processing  under  u  (tt  )  and 
therefore  be  a  candidate  to  cause  an  idle  period.  Suppose  this  task  j 
would  be  processed  on  machine  1 — for  it  to  cause  a  type  I  idle  period  it 
also  has  to  outlast  all  those  tasks  which  still  have  to  receive  their 
second  processing  on  machine  2,  and  then,  after  task  j  finishes  on 
machine  1  and  starts  on  machine  2,  it  has  to  outlast  those  tasks  which 
have  yet  to  receive  their  second  processing  on  machine  1.  So 


PJ  =  qJ 


iG{ B-j }  Wi  +  Uj 


and 


Also 


iS{B-j}  yi  +  Uj 


1 

p0 


* 


p 


0  ■ 


-  -..'■Jr  altflO •>-  *’ * 


-  *  fl— ii 


*  1 

Observe  that  p^  and  p^  do  not  depend  on  which  machine  task  i  (i  r  j) 

has  to  be  processed  the  second  time.  If  task  i  would  be  processed  the 

second  time  on  the  same  machine  it  was  processed  the  first  time,  it  would 
* 

affect  neither  p^  nor  p^  .  This  fact  will  be  used  in  Case  2.  In 

* 

order  to  show  that  E(N  )  <  E(N  )  we  have  to  show  that 


()  je{A-0}(2lJj  qj  i€{B-j}  Ui  +  yj)  j€(A-0}  (2uj  qj  i€{B-J}  Ui  +  Uj  ) 


As  a  prelude  to  showing  the  above,  note  that  when 


2uk  ie{B-k}  Ui  +  Uk  2w2 .  iS{B-J.}  Ui  +  UJ 


Suppose  the  sequence  in  which  tasks  {A}  start  their  first  processing 

under  rr'  is  m,l,2,  ...»  m  -  l,m  +  1,  ...»  r  where  ^2  —  u2  —  ’  ’ '  — 

U  .  <  u  <  u. ,  <...<»  •  Performing  a  pairwise  switch  in  this  sequence 
m-i  m  nrri  r 

gives  l,m,2,  ....  m-l,m  +  l,  ....  r  .  Let  this  new  sequence  correspond 
to  policy  tt  ' *  .  Using  the  relationship  between  qj  and  q j '  , 
j  »  1,  ....  n  ,  (established  by  Lemma  1)  and  (5)  we  find  that  E(N'')  ^E(N') 
After  performing  a  series  of  similar  adjacent  pairwise  interchanges,  each 
one  involving  task  m  and  the  task  immediately  following  it,  (4)  follows. 


Case  2: 


Let  n''1  denote  the  policy  which  instructs  the  decision-maker  at  time 

* 

t  to  start  task  h  with  rate  ,  h  6  {B  -  A)  ,  and  to  adopt  policy  * 
from  the  next  decision  moment  onwards.  Let  qj  ' '  ,  ]  6  A  ,  denote  the 
probability  that  task  j  is  the  last  one  of  tasks  in  {A}  to  finish  its 
first  processing  and  also  finishes  after  task  h  finishes  under  it'"  . 
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Let  q” '  denote  the  probability  that  task  h  finishes  after  all  tasks 

of  {A}  finish  their  first  processing  under  ir"'  .  Assume  in  the  re- 

★ 

maining  part  of  the  proof  that  when  using  tt  from  t  onwards  we  may, 

after  having  started  all  tasks  of  {A}  ,  start  task  h  on  the  machine 

that  comes  free  first  (we  have  seen  under  Case  1  that  the  probability  of 

task  j  causing  a  type  I  idle  period  does  not  depend  on  which  machine 

* 

processes  task  h  for  the  second  time) .  Let  q^  now  denote  the 
probability  that  task  j  is  the  last  one  to  finish  its  first  processing 

f  1  * 

among  tasks  {A}  and  also  finishes  after  task  h  finishes.  Let 
denote  the  probability  that  task  h  finishes  after  all  tasks  of  {A} 
have  finished  their  first  processing.  So  now 


*  * 

PJ  =  qJ 


i€{B-j-h}  ^i  pj 


j  e  A 


and 


-III  _  -III  . 

PJ  qJ 


i£{B-j-h}  ui  + 


j  e  a 


Again 


_f  I  1  __  _ 

Pn  *  Pr 


In  order  to  show  that  E(N  )  <  E(N''')  we  have  to  show  that 


l  (£-■ 

j€{A-0}  \  Zui 


q  •  n 

J  i€{  B-j-h} 


.  - — - \  <  i  /_! 

ui  +  /  ~  je{A-o>V2y 


I 


j  i  iS{ B- j -h }  Wi  +  Wj 


From  Lemma  1  follows  that  q^  >  q^''  and  q^  <_  q^"  ,  i  €  A  .  From  (5) 
follows  then  that  E(N  )  <  E(N''')  .  ■ 
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3.  IDENTICAL  TASKS  ON  TWO  MACHINES  WITH  DIFFERENT  SPEEDS 

In  this  section  we  assume  that  and  ,  j  ■  1,  n  ,  have 

distributions  F  and  G  respectively.  Both  distributions  F  and  G 
are  New  Better  than  Used  (NBU) ,  i.e.. 


F(x  +  y)/F(x)  <_  F(y)  x  ^  0  ,  y  >_  0 


and 


G(x  +  y)/G(x)  <_  G(y)  x  >_  0  ,  y  >_  0  . 


Consider  decision  moment  t  when  one  machine  has  become  idle  and  the 
other  is  busy  processing  a  task.  Let  n^2  denote  the  number  of  tasks 
that  have  not  yet  received  processing  on  either  machine  and  let  n^(n2> 
denote  the  number  of  tasks  Chat  are  waiting  for  processing  only  on 
machine  1  (2) .  When  the  task  that  is  being  processed  at  t  on  the  busy 
machine,  say  machine  1  (2),  is  not  required  to  be  processed  afterwards 
on  the  other  machine,  it  will  be  called  a  task  of  type  1  (2);  if  after 
having  finished  its  current  processing  on  machine  1  (2),  it  is  required 
to  be  processed  afterwards  on  machine  2  (1)  it  will  be  called  a  task  of 
type  12  (21) .  The  type  of  this  task  will  be  designated  by  t  .  Let  z 
denote  the  amount  of  processing  this  task  has  already  received  at  time  t 
on  machine  1  (2).  The  state  S  of  the  process  at  time  t  is  then  com¬ 
pletely  specified  by  the  quintuple  (n^2,n^,n2,x,z)  .  The  random  variable 
M°(S)  will  denote  the  remaining  time  to  finish  all  tasks,  starting  in 
state  S  and  using  policy  tt°  .  In  the  subsequent  lemma  and  theorem, 
the  remaining  time  to  finish  all  tasks,  departing  from  two  different  states, 

say  and  S2  ,  while  using  the  same  policy  or  using  two  different 

1  2 

policies,  say  ir  and  rr  ,  while  departing  from  the  same  state  will  be 


■■wi  Mt.waxxr.'ccsr.i . 
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compared  repeatedly.  However,  whenever  M^(S^)  will  be  compared  with 
( S 2 )  the  amount  of  processing  already  done  on  the  task  in  the  busy 
machine  will  be  identical  in  states  and  S0  (the  types  of  these 

tasks  may  however  differ). 

The  following  notation  will  be  used:  A  D  B  denotes  that  the 
random  variable  A  is  stochastically  larger  than  random  variable  B  , 
i.e.  , 


P (A  >x)  >  P(B  >  x)  Vx  . 


Lemma  2: 


k 

Under  the  optimal  policy  it 


* 

M 


(k  +  1, 2  -  l,n  -  1,t ,z) 


* 

D  M 


(k, 2,  ,m, r , z)  . 


Proof : 

The  distributions  of  the  amount  of  processing  still  to  be  done  on 
either  machine  are  the  same  in  the  two  states.  In  state  (k  +  1, 2  -  l,m  -  1, t , z) 
there  is  an  additional  constraint  in  the  form  of  an  extra  task  which  has 
to  be  processed  on  both  machines.  So  starting  from  state  (k,2,m,t,z)  the 
decision-maker  can  do  at  least  as  well  as  when  starting  from  state 
(k  +  1,2  -  l,m  -  1,t,z)  if  he  acts  optimally  in  the  two  cases.® 

In  the  next  theorem  we  will  use  repeatedly  the  following  approach  when 

comparing  M^(S^)  with  M^"^)  or  M^CS^)  with  M^(S^)  .  The  time  the 

busy  machine  needs  to  finish  the  task  started  before  t  will  have  the 

same  distribution  in  the  two  states  which  are  being  compared.  We  condition 

them  on  which  machine  finishes  first  and  compare  M^(S^)  with 
2 

(or  with  M  (S^))  under  the  condition  that  a  particular  machine  finishes 


first. 
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We  are  now  ready  for  the  main  result  of  this  section. 

Theorem  2: 

The  makespan  is  stochastically  minimized  if  the  decision-maker  whenever 
a  machine  is  freed  starts,  when  possible,  a  task  which  has  not  yet  been 
processed  on  either  machine. 

Proof : 

* 

Let  it  denote  the  policy  which  always  gives  priority  to  the  tasks 

which  have  not  yet  been  processed  on  either  machine.  It  suffices  to  show 

* 

that  at  any  decision  moment  in  any  state  it  is  better  to  use  policy  tt 

* 

than  to  take  an  action  not  prescribed  by  it  (i.e.,  starting  a  task  of 

* 

either  type  1  or  type  2  depending  upon  which  machine  is  idle)  and  use  tt 
from  the  next  decision  moment  onwards.  Call  this  last  policy  it’  . 

So  we  have  to  show  that  for  any  S 

M*(S)  C  M' (S)  . 

In  all  inequalities  to  be  shown  the  time  the  busy  machine  has  been  process¬ 
ing  its  task  (z)  is  the  same  in  the  two  states  being  compared;  a  state 
will  therefore  be  denoted  by  (k,i,m,r)  . 

We  will  show  by  induction  on  k 

A(k)  :  M*(k  -  l,Z,m,12)  C  M*(k,2,  -  l,m,l) 

M*(k-l,*,m,21)  C  M*(k,S.,m-  1,2) 

B(k)  :  M*(k,L*,l)CH'(k,t,m,l) 

M*(k,  2. ,m, 2)  C  M'  (k,4,m,2) 

C(k)  :  M*(k  -  1,2  +  l,m,12)  CM*(k,l,m,l) 

M*(k-l,2,m  +  l,21)  C  M*(k,2,m,2) 
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D(k)  :  M*(k,2,m,12)  C  M' (k,2,,m,12) 

M*(k,2,,m,21)  C  M’ (k,l,m,21)  . 

Showing  B(k)  and  D(k)  for  every  k  ,  2.  and  m  proves  the  theorem. 

At  each  step  only  the  first  of  the  two  inequalities  involved  will  be 
shown  as  the  proof  of  the  second  is  identical. 

Induction  Base:  k  =  1 
A(l): 

On  machine  1  a  task  of  type  12  has  been  receiving  service  for  time  z  . 
Let  Z  denote  the  random  time  needed  to  finish  this  task  on  machine  1. 

As  F  is  NBU 


z  cXi  . 


It  can  be  established  easily  that 

*  I  1  ®4'1  \ 

M  (0,2., m,  12)  =  max  £  X  +  Z  ,  £  Y  ,  Z  +  Y  1 

\i»l  1  i=l  1  Ll 

where  the  first  (second)  terra  between  the  parentheses  on  the  R.H.S.  repre¬ 
sents  the  total  amount  of  work  still  to  be  done  on  machine  1  (2)  and  the 
third  term  represents  the  time  needed  to  finish  the  task  of  type  12. 

The  third  term  is  the  largest  iff  the  task  of  type  12  causes  an  idle 
period  of  type  I.  On  the  other  hand 

*  l  1  m+1  \ 

M  (1,1  -  l,m,l)  -  max  ^  +  Z  ,  J  Yi  »  XX  +  Yi| 


A 


«.? 


so  A(l)  clearly  holds. 
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B(l)  : 

It  was  shown  before  that 

*  /  n+1  \ 

M  (l,4,m,l)  =  max  ^  J  X±  +  Z  ,  l  Y±  ,  ^  . 

Under  policy  it'  the  task  which  has  to  be  processed  on  both  machines 
will  not  be  started  immediately.  But  starting  this  task  later  is  equiva¬ 
lent  with  a  larger  third  term  on  the  R.H.S.  Clearly  B(l)  holds. 

C(l) : 

This  case  is  identical  to  A(l)  . 


D(l): 

It  can  be  shown  easily  that 

*  /  \ 

M  (1,4,0,12)  -  max  ^  £  Xt  +  Z  ,  £  Yi  ,  Xj.  +  Yj.  ,  Z  +  yA 

where  the  third  and  fourth  term  represent  the  times  needed  to  finish  the 
two  t -\sks  which  still  have  to  receive  processing  on  both  machines.  Under 
ir'  the  only  remaining  task  waiting  for  both  machines  will  not  be  started 
immediately.  But  starting  this  task  later  is  equivalent  with  a  larger 
third  term  on  the  R.H.S.  So  D(l)  holds. 

General  k  : 

To  prove  A(k) ,  ....  D(k)  for  arbitrary  k  ,  assume  A(k-l),  ....  D(k-l) 
to  hold.  We  will  show  A(k) ,  ...,  D(k)  by  induction  on  l  +  m  . 
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Induction  Base  l  +  m  »  1  : 

Mk)  : 

To  show 

M*(k  -  1,1,0,12)  C  M*(k, 0,0,1)  . 

If  machine  1  finishes  first  it  suffices  to  show 

M*(k  -  2,1,1,21)  C  M*(k  -  1,0,0,21)  . 

This  holds  because  of  Lemma  2.  If  machine  1  finishes  first  it  suffices 
to  show 

M*(k  -  2,2,0,21)  C  M*(k  -  1,1, 0,1)  • 

This  holds  because  of  A(k  -  1)  . 

B(k)  : 

To  show 

M*(k, 1,0,1)  C  M’(k, 1,0,1) 

and 

M*(k, 0,1,1)  C  M' (k, 0,1,1)  . 

* 

In  state  (k, 1,0,1)  both  it  and  tt'  have  to  take  the  same  action  so 
it  suffices  to  consider  state  (k, 0,1,1)  .  The  case  of  machine  1  finish¬ 
ing  first  holds  because  of  A(k)  for  l  +  m  •  1  .  In  case  machine  2 

* 

finishes  first  the  next  state  will  be  under  both  n  and  tt 
(k-l,l,l,l)  . 
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cOil  : 

To  show 

(1)  M* (k  -  1, 1, 1, 12)  C  M*(k, 0,1.1)  • 

The  case  of  machine  1  finishing  first  holds  because  of  Lemma  2.  The 
case  of  machine  2  finishing  first  holds  because  of  C(k-l)  . 

(ii)  M*(k-1, 2,0, 12)  C  M*(k,  1,0,1)  • 

The  case  of  machine  1  finishing  first  holds  because  of  Lemma  2  and  the 
case  of  machine  2  coining  free  first  holds  because  of  C(k-l)  . 

MiO  •' 

To  show 

M*(k,l,0,12)  C  M'(k,l,0,12) 

and 

M*(k,0,l,12)  C  M’ (k,0,l,12)  . 

* 

As  in  state  (k, 1,0,12)  both  v  and  7 r  have  to  take  the  same  action, 
it  suffices  to  show  only  the  second  inequality.  The  case  of  machine  1 
coming  free  first  holds  because  of  C(k)  for  t  +  m  ■  1  .  The  case  of 
machine  2  coming  free  first  holds  because  of  Lemma  2. 

General  l  +  m  : 

Assume  A(k) ,  ....  D(k)  to  hold  for  l  +  m  -  1  . 

ACk)  : 

To  show 


M*(k  -  l,2.,m,12)  C  M*(k,£  -  . 


The  case  of  machine  1  coming  free  first  can  again  be  handled  through 
Lemma  2.  The  case  of  machine  2  finishing  first  holds  because  of  A(k  -  1) 


To  show 


M  (k,i,m,l)  C  M' (k,£,m,l) 


The  case  of  machine  1  coming  free  first  holds  because  of  A(k)  .  The 
case  of  machine  2  finishing  first  holds  because  of  Lemma  2. 


COO  : 


To  show 


M*(k  -  1,4  +  l,m,12)  CM*(k,i,m,l) 


The  case  of  machine  1  coming  free  first  holds  because  of  Lemma  2.  The 
case  of  machine  2  finishing  first  holds  because  of  C(k-l)  . 


POO  : 


To  show 


M  (k,4,m,12)  C  M’ Ck,Z,m,2) 


The  case  of  machine  1  coming  free  first  holds  because  of  C(k)  .  The 
case  of  machine  2  finishing  first  holds  because  of  Lemma  2.B 
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4.  IDENTICAL  TASKS  WITH  EXPONENTIAL  PROCESSING  TIMES  ON  IDENTICAL  MACHINES 

In  this  section  we  consider  the  case  where  both  and  Y  , 

i  ■  1,  . ..,  n  ,  are  exponentially  distributed  with  mean  one.  We  present 
a  closed  form  solution  for  the  expected  makespan  under  the  optimal  policy. 
From  Section  1  we  have 


(6) 

E(M*)  =  E  ma 

*  (  I  X 

i  01 

_ 

\i-l  1 

i-1  VJ 

Consider  the  first  term  on  the  R.H.S.  of  (6).  Clearly 


(7) 

E  ma 

x  (  l  X  , 

l  Y  M  -  2n  -  E  mi 

«  (  !  X±, 

!  yJ 

\i«l  1 

i-1  i/J  L 

\i-l  1 

i-i  i/j 

In  order  to  compute  the  second  term  on  the  R.H.S.  of  (7)  suppose  we  have 
a  stockpile  of  n  type  1  and  n  type  2  components,  each  of  which  function 
for  an  exponential  time  with  mean  1.  Suppose  further  that  for  the  "system" 
to  work  there  must  always  be  both  a  single  type  1  and  type  2  in  service. 

If  T  represents  the  system  lifetime  then  E[Tj  is  the  desired  expectation. 
Letting  N  be  the  number  of  components  that  fail  we  obtain 
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To  compute  )  P  assume,  without  loss  of  generality,  that  the  order- 

j-1  2 

ing  1,2,  ....  n  is  used  (the  ordering,  of  course,  being  irrelevant  since 


all  rates  are  equal).  Now  p 


;  -  (if 


for  j  *  1  or  2  for  in  either 


case  n  -  1  services  must  finish  before  j  and  when  j  then  switches 
machines  once  again  n-1  services  must  finish  before  it.  For  j  >  2 
suppose  at  the  moment  the  element  is  first  serviced  by  a  machine  there 
have  been  a  total  of  i  completions  on  that  machine  and  j  -  2  -  i  on  the 
other.  The  probability  that  j  would  cause  a  type  1  idle  period  in  this 
case  would  thus  be 


As  the  above  does  not  depend  on  i  we  see  that 


and  so 


implying  that 


*  / l\2n-2  *  / l\2n~j  .  . 

pi  *  It)  -rr\V  ■i>-2 


1?  *  /l\2n-l  /l\n 

I  \  'i '  (i)  *  (V  -  \V  ‘  (?) 
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